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A method for optimizing of data transmission 

TECHNICAL FIELD OF THE INVENTION 

5 The invention is related to optimization of data transmission in TCP/IP networks, 
particularly to problems created by transmission of encrypted traffic. 

BACKGROUND OF THE INVENTION 

10 TCP/IP network technology is presently in widespread use, the Internet being a 
manifest example of a network realized using the Transmission Control Protocol 
(TCP) and Internet Protocol (IP). The IP protocol provides a basic packet data 
transfer mechanism without error checking, acknowledgments or flow control. The 
TCP protocol provides a reliable data transmission mechanism with transmission 

15 error correction, flow control and many other functions. The IP protocol is defined 
in the specification RFC 791, and the TCP protocol is defined in the specification 
RFC 793. An introduction to these protocols is presented in RFC 1 180. 

The IP protocol version 4 (IPv4) defined by RFC 791 has a limited address space 
20 due to the source and destination addresses being only 32 bit long. The current 

expansion of the Internet and the development of technology, the address space is 

filling out quickly. Therefore, version 6 of the IP protocol (IPv6) has been designed. 

The addresses in IPv6 are 128 bits long, allowing a vastly larger address space. 

There are also further motivations behind IPv6 and other differences between IPv4 
25 and IPv6. The IPv6 protocol is described in the specification RFC 1883. Some 

details of the TCP and IP protocols relevant to the present invention are described in 

the following with reference to figures 1, 2, and 3. 

In the IP protocol, data is transmitted in so called datagrams, which contain a header 
30 part and a payload data part. Figure 1 shows the structure of an IPv4 header. In the 
following only some of the header fields are described. A detailed description can 
be found from the above mentioned RFC 791. The first field, the four bits long 
version field, contains the version number which for IPv4 is 4. The total length field 
gives the length of the datagram, header and data part combined, as the number of 
35 octets i.e. groups of 8 bits. The source and destination addresses specify the IP 
address of the sender and the intended receiver. Various options can be specified in 
the options field, which may vary in length from datagram to datagram. The number 
of different options specified in the options field may as well vary. The options field 
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is not mandatory, i.e. in some datagrams there may be no options field at all. The 
padding field is used to ensure that the header ends on a 32 bit boundary. The 
padding field is filled with zeroes. After the padding field comes the payload data 
part, whose length can be found out by the recipient of the datagram by subtracting 
5 the length of the header from the value of the total length field. 

Figure 2 illustrates the structure of an IPv6 header. The IPv6 header is simpler than 
the IPv4 header, allowing faster processing of datagrams in transmission nodes. The 
first four bits of the header comprise the version field, which for IPv6 contains the 

10 value 6. The payload length field specifies the length of the data part in octets. The 
next header field specifies the type of any header following this header. The next 
header may for example be a TCP header in case the IP datagram carries a TCP 
packet, or an extension header. The source and destination address fields, each 
consisting of four 32-bit words giving a total of 128 bits for each address, specify 

15 the sender and the intended receiver of the datagram. Instead of an options field, 
inclusion of optional data in the header is provided in IPv6 by so called extension 
headers. Various extension header types are described in RFC 1883. There may be 
zero, one or more than one extension headers in an IPv6 datagram. Each IPv6 
datagram comprises extension headers for only those facilities that the datagram 

20 uses. The extension headers are placed after one another after the main header in a 
chain- like fashion. Each extension header comprises a Next header field. The next 
header field of the main header specifies the type of the first extension header, and 
the next header field of each extension header specifies the type of the following 
extension header. A special value in the next header field specifies that no more 

25 headers follow this specific header. 

Figure 3 illustrates the structure of a TCP header. The most relevant fields are 
described in the following. The other fields in a TCP header are described in the 
above mentioned RFC 793. 

30 

The TCP header indicates a destination port number at the receiving host, to which 
the packet is directed. The TCP protocol makes it possible for many different 
services to exist at a single IP address, by introducing the concept of a port. A 
program can listen to a specific port, and receive any data sent to that port. 
35 Conversely, a program can send a packet to a specific port on a distant host. 
Therefore, the destination port number defines which service or program will 
receive the packet at the host specified by the IP address. Similarly, the source port 
number indicates, which service or program sent the TCP packet. 
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The TCP data octets sent by a host are numbered sequentially. The number of the 
first octet of data in the data part is included in the TCP header in the sequence 
number field. Based on this number, the receiving second host can check whether 
5 TCP packets have arrived through the transmission network in the right order, and if 
any packets are missing. The second host conventionally sends an acknowledgment 
to the first host for each received packet. The acknowledgment message is included 
.in a normal TCP packet sent by the second host to the first host. The 
acknowledgment is indicated by the ACK flag and the acknowledgment number. 

10 The acknowledgment number is the sequence number of the next octet, which the 
sender of the packet is expecting to receive from the other end. If there is no other 
data to be sent from the second host to the first host, the payload data part can be 
empty in such an acknowledgment packet. If the second host is transmitting data to 
the first host, the acknowledgment can be indicated in the header of a packet 

15 containing some payload data. Therefore, the ACK messages do not always add 
transmission load. If a host does not receive an acknowledgment for some data 
within a timeout period, the data is retransmitted. 

The data part follows the TCP header. The length of the data part is carried by the IP 
20 protocol, therefore there is no corresponding field in the TCP header, 

TCP is one of the few transport protocols that has its congestion control 
mechanisms. The key congestion control mechanism in TCP is the "slow start" 
mechanism, which functions in the following way. According to the TCP protocol, 

25 the sender starts sending data at a very slow rate, and monitors acknowledgment 
ACK messages from the receiving end to see, if any data is lost. If no data is lost i.e. 
sender always receives an ACK, the TCP sending host increases the data rate. The 
sending increases the data rate, until data is lost, which the sender can observe as 
missing ACK messages. The data loss typically results from the behavior of 

30 intermediate hosts: if an intermediate node cannot forward a data packet due to 
congestion, the node simply discards the packet. The sending host then retransmits 
the packet at a later time, since no ACK message was received from the receiving 
host due to disappearance of the packet. When the sending host notices that ACK 
messages have not been received for a data packet, the sending host decreases the 

35 data rate, until no more data is lost. When each transmitted packet again results in an 
ACK message, the sending host starts increasing the data rate again. Consequently, 
an oscillating behavior results, in which the TCP transmission oscillates with a 



period of 1 to 2 seconds, and data is lost on one part of the cycle and the capacity of 
the network is not used in an optimum way on the other part of the cycle. 

Recently, a new mechanism for controlling congestion situations in a TCP/IP 
network has been presented, for example, in an article entitled "A Simple Fast Flow 
Control for TCP/IP over Satellite ATM Network" by Jian Ma, published in the 
proceedings of the wmATM 98 conference, 6-10 April 1998, Hangzhou. This 
mechanism, called Fast TCP or FTCP, alleviates the problems of oscillation. In this 
mechanism, when an intermediate node detects a congestion situation, it delays the 
ACK messages returning from the receiving end. As a result of ACK messages 
being delayed, the sending host delays the sending of further data packets, which 
reduces congestion. In this way, congestion can be controlled without loss of data. 

Fast TCP is only one example of various control mechanisms which rely on 
identification of the contents of IP packets, i.e. identification of TCP messages. 
Another example of such a mechanism is a method described by R. Satyavolu et al 
in ATM Forum Document 98-0152 "Explicit rate control of TCP applications", 
which utilizes the window value carried in the TCP header for rate control of TCP 
traffic. The main idea of this method is to modify the contents of the window size 
field in the TCP header. This method does not work if a network element is not able 
to access the encrypted IP payload, identify the original window size, read it and 
communicate the modified value to the TCP source with the IP datagram. Other 
examples concerning control of TCP traffic have also been proposed by MIT and 
End-to-End Research Group of the Internet Research Task Force respectively in 
"An Acknowledgment Bucket Scheme for Regulating TCP Flow over ATM", in 
Globecom 97, Nov. 1997, and "ACK spacing for high delay-bandwith paths with 
insufficient buffering", Internet Draft, July 1997. The ATM Forum document 
ATMF97-758rl entitled "TCP flow control with ACR information", December 
1997, describes an example of using TCP ACKs as a flow control interworking 
media. 

Encryption of IP traffic is often desirable for security reasons. In encrypted IP 
traffic, all payload data of the IP datagrams is encrypted. Since the TCP header and 
data are carried as payload data in IP datagrams, all TCP header information is 
encrypted as well along with TCP data. 

However, IP encryption creates a problem, when any mechanisms relying of 
identification of TCP messages are used. Any mechanisms which rely on the 
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recognition and possible processing of TCP ACK messages require that at least 
some of the intermediate nodes participating in the mechanisms are able to read the 
contents of the IP packets. If the IP traffic is encrypted, the intermediate nodes 
cannot identify the TCP messages. Therefore, the intermediate nodes are unable to 
5 perform the control mechanisms based on TCP ACK messages. 

SUMMARY OF THE INVENTION 

An object of the invention is to realize a method for transmission of encrypted IP 
10 traffic, which allows control of the data transmission based on information carried 
in headers of TCP packets. A further object of the invention is to realize a method 
for transmission of encrypted IP traffic, which allows control and/or processing of 
TCP ACK messages. 

15 The objects are reached by inserting at least an indication of the presence of the 
information on which the control is based into the header of the IP datagram 
carrying the TCP packet. The insertion of said at least an indication may comprise 
placing of at least a copy of the information on which the control is based into the 
header of the IP datagram. 

20 

The method according to the invention is characterized by that, which is specified in 
the characterizing part of the independent method claim. The dependent claims 
describe further advantageous embodiments of the invention. 

25 According to the invention, at least an indication of a TCP ACK or other TCP 
information used as a basis of processing is placed in the IP header of an IP 
datagram, if such information is carried by the IP datagram. The indication may 
simply be a flag indicating the presence of a TCP acknowledgment. The indication 
may also contain the acknowledgment number or other TCP header information, 

30 which allows processing of the encrypted traffic based on the acknowledgment 
number or other TCP header information. In IPv4 datagrams, the indication may be 
inserted as an extra option field. In IPv6 datagrams, the indication may be inserted 
as an extension header. 

. 35 BRIEF DESCRIPTION OF THE DRAWINGS 

The invention is described in more detail in the following with reference to the 
accompanying drawings, of which 
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Figure 1 illustrates the structure of an IPv4 header, 

Figure 2 illustrates the structure of an IPv6 header, 

5 

Figure 3 illustrates the structure of a TCP header, 

Figure 4 illustrates one advantageous embodiment of the invention, 

10 Figure 5 illustrates the structure of the option code octet of an option field in an 
IPv4 header, 

Figure 6 illustrates the structure of an IPv6 extension header according to an 
embodiment of the invention, and 
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25 



Figure 7 illustrates signalling according to an advantageous embodiment of the 
invention. 

Same reference numerals are used for similar entities in the figures. 
DETAILED DESCRIPTION 

In the following, four groups of embodiments of the invention are described in 
further detail. 

FIRST GROUP OF EMBODIMENTS 



In the first group of embodiments, the source originating the TCP traffic being 
acknowledged performs the decryption of the TCP traffic. In order to allow an 

30 intermediate network element to perform ACK based processing, information about 
ACK messages contained in the received packets are signalled to any such 
intermediate network elements performing ACK based processing. Encrypted IP 
packets are decrypted at the TCP source host, and before conventional TCP 
processing, the ACK information is routed to the entity performing the ACK-based 

35_ control or processing. There may be one or more such entities. When there are more 
than one such entities, the ACK information is sent to all of these entities. The entity 
may be an intermediate network element, or a control member within the TCP 
source host. 
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Figure 4 illustrates the configuration in an advantageous embodiment of the 
invention, which embodiment is an example of the first group of embodiments. 
Figure 4 illustrates a source network element 10, an intermediate network element 
5 20 and a destination network element 30 as well as communication links 5 between 
the elements. Figure 4 further illustrates the protocol stacks at each element, in 
which stack the physical layer is lowest, IP layer above the physical layer and the 
TCP layer above the IP layer. According to this embodiment, a further 
communication channel 6 is set up between the source network element 10 and the 
10 intermediate network element 20, which communication channel is used to transmit 
information about ACK messages contained in the received packets. This 
configuration allows the intermediate network element to process the traffic, even 
though the IP traffic is encrypted. 

15 In one advantageous embodiment of the invention, the ACK messages are stored in 
a queue at the source host, and information about the messages is signalled to a 
ACK processing network element. The source host waits for commands from the 
network element before further processing of the queued ACK messages. 

20 In another advantageous embodiment of the invention, any ACK message 
information found in decrypted packets is signalled to a network element and 
subsequently discarded by the source host. In this embodiment, the network element 
inserts the ACK messages in the traffic for example unencrypted. When the source 
host receives unencrypted ACK messages, the source host performs normal ACK 

25 processing. In this embodiment, the source host may comprise an acknowledgment 
message routing unit, which routes the ACK messages found in encrypted packets to 
any intermediate network elements performing ACK based processing, and allows 
ACK messages found in unencrypted packets to be processed in the normal way by 
the source host. 

30 

In a further advantageous embodiment of the invention, the ACK-based processing 
is performed in the source host, which decrypts the encrypted IP traffic. In this 
embodiment, a network element performing ACK processing for unencrypted 
traffic, signals any further information needed for the ACK processing to the source 
35 .. host in case of encrypted traffic, whereby the source host is able to perform similar 
processing. Said further information may comprise for example information about 
the congestion situation of the network as observed by the network element. 
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SECOND GROUP OF EMBODIMENTS 

The problems associated with ACK processing of encrypted IP traffic can also be 
solved by providing network elements performing the processing with the capability 
5 to decrypt IP packets. In such an embodiment, the network element is able to 
decrypt the IP packets and perform the network control functions, such as FTCP 
processing, in the normal way. Such an embodiment has for example such an 
advantage that no changes are needed in the programs performing TCP and IP 
processing and IP encryption and decryption at either source or destination host. The 
10 actual realization of such an embodiment is naturally dependent on the encryption 
system used for encryption of the IP datagrams. For example, the entity performing 
the encryption may transmit to the network element the decryption key needed for 

p the decryption of the IP datagrams. As an another example, the network element 

may be provided with decryption keys for a number of TCP connections, which 

Lq 15 connections are processed by the network element. 

~ THIRD GROUP OF EMBODIMENTS 

I *: | 

^ The problems associated with ACK processing of encrypted IP traffic can also be 

fy 20 solved by using plain, i.e. unencrypted ACK messages. In such an embodiment, the 

J-f entity performing the encryption of IP datagram payload data leaves such datagrams 

unencrypted, which datagrams contain a TCP ACK message. Other datagrams are 
-J3 encrypted in the normal way. This method allows processing of ACK messages by 

intermediate network elements to proceed in the normal way, since the ACK 
25 messages are not encrypted. 

In this embodiment, the TCP destination host is required to produce both encrypted 
and plain IP packets belonging to the same TCP connection, and the TCP source 
host is required to be able to receive both encrypted and plain IP packets. 



30 



Preferably, in this embodiment, TCP ACK messajges are sent in otherwise empty 
TCP packets, i.e. no data is sent in those packets containing an ACK message, in 
order to avoid sending payload data unencrypted. 



35 



This embodiment-has such an advantage, that it does not require additional 
signalling channels, and that more than one network elements can observe the ACK 
messages without special arrangements. Therefore, this embodiment allows easy 



changes in the network topology, such as increasing the number of intermediate 
network elements. 



FOURTH GROUP OF EMBODIMENTS 

5 

According to a further embodiment of the invention, an indication that a TCP ACK 
message is contained in an encrypted IP datagram is placed in the header of the IP 
datagram. This allows the intermediate network elements to perform processing 
based on the ACK messages despite the fact that the ACK messages themselves are 
10 encrypted. An indication of an ACK message without the ACK number is sufficient 
to such processing, which does not need the ACK number. In another embodiment 
of the invention, also the ACK number is placed in the IP header. This allows 
functioning of such mechanisms, which need the ACK number in some way. For 
example, such mechanisms may then modify the ACK number. 

15 

With IPv4 datagrams, the indication of an ACK message may be incorporated in the 
IP header as an extra option field. The ACK number may as well be incorporated in 
the IP header as an extra option field. The indication of an ACK message and the 
ACK number may be contained in the same option field, or they may be placed in 
20 separate option fields. The invention does not limit the encoding of the indication of 
an ACK message nor the encoding of the ACK number in the extra option field or 
fields in any way. A person skilled in the art can devise many different ways of 
encoding the indication of ACK and the ACK number in an extra option field of an 
IPv4 header. 

25 

The ACK message or an indication of an ACK message can be encoded in many 
ways in an IPv4 header. For example, an indication of an ACK message can be 
included in the Type of Service (TOS) field. The bits 6 and 7 of the TOS field are 
unused according to current IPv4 specifications, whereby one of these two bits 
30 could for example be used to indicate an ACK message. For example, in one 
embodiment of the invention, bit 6 of the TOS field of an IP datagram is set to 1 , if 
the IP datagram comprises a TCP ACK message and to 0, if the IP datagram does 
not comprise a TCP ACK message. 

35 In another advantageous embodiment of the invention, the encoding of an ACK 
message is realized by copying at least a part of the TCP header into an option field 
of an IPv4 datagram. Figure 5 illustrates the structure of an option field. An option 
field contains either an option type octet only, or an option type octet, an option 
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length octet and data. The first bit of the option type octet i.e. bit number 0 
indicates, whether the option field should be copied only to the first fragment of an 
IP datagram in such a case, when the IP datagram is fragmented at some point 
during its transmission. If the first bit is set to 0, only the first fragment shall contain 
5 the option field. If the first bit is set to 1, the option field is copied to all fragments. 
Bits 1 and 2, i.e. Option Class bits describe the class of the option. In this example 
of an embodiment, these bits can be set to 0, in which case the option class bits 
indicate that the option class is "control", i.e. contents of the field are associated 
with datagram or network control. The remaining bits of the Option Code octet, i.e. 

10 the Option Number field indicates the use of the option field. For this embodiment 
of the invention, one of the currently unused option numbers should be defined to 
indicate, that the option field contains at least a part of the TCP header carried in the 
IP datagram. For example, option number 15 could be defined to indicate this. The 
meaning of the various values of the Option Class bits and the Option Number bits 

15 are defined in the previously mentioned specification RFC 791. The option length 
octet indicates the length of the whole option field in octets. The data part of the 
option field contains the actual data of the option field. Preferably, in this 
embodiment the data part comprises at least the TCP acknowledgement number. 
The data part may also comprise a whole TCP header. 

20 

In an advantageous embodiment of the invention, the existence of an option field 
containing a TCP header is used as an indication of a TCP ACK or other TCP 
information. 

25 In an advantageous embodiment of the invention, an indication of an ACK message 
may be incorporated in an IPv6 datagram as an extension header. The ACK number 
may as well be incorporated as an extension header, and the indication and the ACK 
number may be incorporated in the same extension header or as separate extension 
headers. According to this embodiment of the invention, a new extension header 

30 type needs to be defined, i.e. a type specifying that the extension header contains at 
least a part of a TCP header. In the following, such an extension header is called the 
TCP extension header. 

The TCP extension header can be inserted for example before the Authentication 
35 and Encapsulation security payload (ESP) extension-headers in an IPv6 datagram. 

Figure 6 illustrates an example of the structure of a TCP extension header according 
to an advantageous embodiment of the invention. In this embodiment, the TCP 
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extension header contains a Next header field specifying the type of the next header, 
a Length field specifying the length of the extension header in 8-octet units, the TCP 
header or at least a part of it, and possibly padding to fill up any remaining space 
until the length of the extension header is a multiple of 8-octet units as required by 
5 RFC 1883. The padding may be realized for example in the way described in section 
4.2 of RFC 1883, i.e. by using a single octet of zeroes when only one octet of 
padding is needed, and by using a single octet of ones, an octet specifying padding 
length minus two, and N-2 octets of zeroes, when N octets of padding are needed. 

10 Preferably, the entity which performs the encryption of IP datagrams performs the 
incorporation of the indication of an ACK message in the IP header. The entity 
performing the incorporation is preferably the TCP destination host, which creates 
the ACK messages. 

15 However, the invention is not limited to incorporation of an indication of an ACK 
message in the TCP destination host. For example, the TCP destination host 
encrypting the IP datagrams may communicate information to a further processing 
entity, the information indicating which IP datagrams contain an ACK message, and 
the associated ACK numbers. The further processing entity may then add an 

20 indication of an ACK message and possibly also the ACK number to those 
encrypted IP datagrams, which are pointed out by the TCP destination host as 
containing an ACK message. Therefore, the process of incorporation of an 
indication of an ACK message does not need to be performed by the same entity 
performing the IP encryption. 

25 

Incorporation of an indication of an ACK message into the IP header has for 
example such an advantage, that the TCP source host programs performing the IP 
decryption and TCP processing do not necessarily need to be changed. The source 
host can simply ignore the indication of the ACK message. In such embodiments of 
30 the invention, where the ACK number is also incorporated in the IP header and 
various processing mechanisms in the intermediate nodes may modify the ACK 
number, conventional TCP source host programs do need to be modified to the 
degree, that the programs use the modified ACK number from the IP header and not 
the unchanged ACK number from the decrypted TCP packet. 

35 

Incorporation of an indication of an ACK message into the IP header has for 
example also such an advantage, that no TCP payload data needs to be sent without 
encryption, even if a TCP packet contains both an ACK message and payload data. 
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Figure 7 shows one example of signalling according to one embodiment belonging 
to the fourth group of embodiments. Figure 7 shows signalling between a source 
host 10, a network element 20 and a destination host 30. First, the source host 10 
5 sends 100 a packet to the network element 20, which forwards 1 10 the packet to the 
destination host 30. The destination host then encrypts a datagram for transmission 
back to the source host. In this case, the TCP packet in the datagram contains an 
acknowledgment, wherefore the destination host inserts 115 an indication of the 
ACK message in the header of the encrypted IP packet. After preparation of the 

10 packet with the acknowledgment, the destination host sends 120 the packet to the 
network element 20. The network element observes from the IP header that the 
packet contains an ACK message. In this example, the network is congested at this 
time, wherefore the network element delays 130 the datagram containing the ACK. 
When the congestion has eased enough, the network element forwards 140 the 

15 datagram to the source host. Figure 7 shows also a further example of signalling in 
case of no congestion. The source host 10 sends 150 a packet to the network 
element 20, which forwards 160 the packet to the destination host 30. The 
destination host then encrypts a datagram for transmission back to the source host. 
In this case, the TCP packet in the datagram contains an acknowledgment, 

20 wherefore the destination host inserts 165 an indication of the ACK message in the 
header of the encrypted IP packet. After preparation of the packet with the 
acknowledgment, the destination host sends 170 the packet to the network element 
20. In this case, the network is not congested, whereby the network element simply 
forwards 180 the packet to the source host. The detection of congestion may be 

25 performed for example on the basis of packet delays, delays of acknowledgment 
messages or by any other method known to a person skilled in the art. 

In this specification, the term encrypted IP datagram refers to an IP datagram, whose 
data payload is encrypted at least in part. 

30 

The present invention can advantageously be used in connection with previously 
described fast TCP mechanism. However, the invention is not limited to such an 
embodiment. The invention can advantageously also be used in connection with 
other mechanisms, which process TCP traffic based on TCP header information, 
35 such as. window size or acknowledgment messages. Therefore, the previous 
examples of ACK processing do not limit the invention in any way. In various 
embodiments of the invention, similar processing can be based on for example the 
window size value instead of the ACK number. 
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In view of the foregoing description it will be evident to a person skilled in the art 
that various modifications may be made within the scope of the invention. While a 
preferred embodiment of the invention has been described in detail, it should be 
apparent that many modifications and variations thereto are possible, all of which 
fall within the true spirit and scope of the invention. 



